井下巷道大视差图像拼接算法

Stitching algorithm of large parallax images in underground roadways

  • 摘要: 针对煤矿井下巷道视频监控采用定点旋转摄像头成本较高、拍摄视野和图像拼接效果有限等问题,设计了摄像头排列布局方式进行大视差拍摄,针对大视差拍摄的图像拼接困难问题,提出了一种基于多平面多感知缝合线的井下巷道大视差图像拼接算法。首先,采用尺度不变特征变换算法对输入图像进行特征点检测和匹配,得到特征匹配点;然后,基于多平面进行特征匹配点分组并产生相应的对齐候选单应性矩阵,每个单应性矩阵对齐图像中的1个平面,解决了巷道大视差场景下平面不一致问题;最后,在每组局部对齐图像上计算基于颜色、边缘及显著度的多感知缝合线,选择缝合线能量最小的对齐图像合成拼接图像,减少了局部区域错位现象。实验结果表明,该算法与APAP,ANAP,SPHP,NISwGSP,RobustELA等经典图像拼接算法及基于颜色的缝合线算法相比,有效消除了局部区域错位和重影问题,图像拼接效果更自然、无缝。

     

    Abstract: In order to solve problems of high cost of fixed -point rotating cameras for video surveillance in underground roadways as well as limited visual field and image stitching effects, a camera arrangement is designed for large parallax shooting. For difficult image stitching caused by large parallax, a stitching algorithm of large parallax images in underground roadways is proposed which is based on multi -plane and multi -perception seam. Firstly, scale -invariant feature transform algorithm is used to detect and match feature points of the input images to obtain feature matching points. Secondly, feature matching points are grouped based on multi -plane, and corresponding alignment candidate homography matrixes are generated. Each homography matrix aligns to one plane in the image, so as to solve plane inconsistency problem in large parallax scene of roadway. Finally, multi -perception seams based on color, edge and saliency are calculated in each group of local aligned images, and the aligned image with the minimum stitch energy is selected to synthesize the stitched image, so as to reduce local area dislocation. The experimental results show that compared with classic image stitching algorithms including APAP, ANAP, SPHP, NISwGSP and RobustELA and color -based stitching algorithm, the proposed algorithm effectively eliminates local area dislocation and ghosting, and achieves more natural and seamless stitching image.

     

/

返回文章
返回